User interface for a head mounted display

ABSTRACT

A headset comprises an arrangement and a display. The arrangement is situated at least partially on a head of a user. The display is coupled to the arrangement and capable of displaying a pointing device to the user. The headset is coupled to a mobile device which includes a sensor. When the mobile device is moved, the sensor detects a direction of the movement to generate corresponding direction data. The display displays to the user a corresponding movement of the pointing device which is determined as a function of the corresponding direction data.

CROSS REFERENCE TO RELATED APPLICATIONS

This Application is a continuation of U.S. patent application Ser. No.11/940,546 filed on Nov. 15, 2007, the contents of which are expresslyincorporated herein, by reference in their entirety.

FIELD OF THE INVENTION

The present invention relates generally to a user interface for a headmounted display. Specifically, movements performed with the userinterface are translated for a pointing device of the display.

BACKGROUND

A mobile unit may be used in a variety of environments. The mobile unitis utilized without a need to be connected to an external power supply.In order to maximize productivity with the mobile unit, a largeworkspace is beneficial. The mobile unit may be equipped with variousaccessories such as a headset in order to increase the workspace. Theheadset may provide a user with an audio input and an audio outputcomponent. Furthermore, the headset may include a head-mounted displayso that the user is not required to view a display of the mobile unit.The head-mounted display may function substantially similar to thedisplay of the mobile unit. For example, the head-mounted display may beequipped with a pointing device. The pointing device may be controlledusing a mouse or a joystick. However, this approach restricts themobility offered by the mobile unit. If the mobile unit is hand-held,the other free hand is required to use the control device. If the mobileunit is mounted, at least one hand is required to use the controldevice.

SUMMARY OF THE INVENTION

The present invention relates to a headset comprising an arrangement anda display. The arrangement is situated at least partially on a head of auser. The display is coupled to the arrangement and capable ofdisplaying a pointing device to the user. The headset is coupled to amobile device which includes a sensor. When the mobile device is moved,the sensor detects a direction of the movement to generate correspondingdirection data. The display displays to the user a correspondingmovement of the pointing device which is determined as a function of thecorresponding direction data.

DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a first view of a headset according to an exemplaryembodiment of the present invention.

FIG. 2 shows a second view of the headset of FIG. 1 according to anexemplary embodiment of the present invention.

FIG. 3 shows components of a mobile unit used with the headset of FIG. 1according to an exemplary embodiment of the present invention.

FIG. 4 shows an assembled system of components including the headset ofFIG. 1, the mobile unit of FIG. 3 and a module according to an exemplaryembodiment of the present invention.

FIG. 5 a shows a first movement of the mobile unit of FIG. 3 accordingto an exemplary embodiment of the present invention.

FIG. 5 b shows a first translation of the first movement of FIG. 5 a ona head-mounted display according to an exemplary embodiment of thepresent invention.

FIG. 6 a shows a second movement of the mobile unit of FIG. 3 accordingto an exemplary embodiment of the present invention.

FIG. 6 b shows a second translation of the second movement of FIG. 6 aon a head-mounted display according to an exemplary embodiment of thepresent invention.

FIG. 7 a shows a third movement subsequent to the second movement ofFIG. 6 a of the mobile unit of FIG. 3 according to an exemplaryembodiment of the present invention.

FIG. 7 b shows a third translation of the third movement of FIG. 7 a ona head-mounted display according to an exemplary embodiment of thepresent invention.

DETAILED DESCRIPTION

The exemplary embodiments of the present invention may be furtherunderstood with reference to the following description and the appendeddrawings, wherein like elements are referred to with the same referencenumerals. The exemplary embodiments of the present invention describe auser interface for a head-mounted display. Specifically, the exemplaryembodiments of the present invention may utilize a motion or inertialsensor disposed in the interface device to detect a motion that istranslated into a movement of a pointing device shown on the display.The interface device may be embodied in a hand-held MU or an accessorythereto. The user interface, the head-mounted display, the sensor, theMU, and the accessory will be discussed in more detail below.

FIG. 1 shows a first view of a headset 100 according to an exemplaryembodiment of the present invention. The headset 100 may be any devicecapable of being worn on a user's head where components of the headsetare used to perform a functionality. For example, the headset 100 may befor a voice functionality. The headset 100 may also be configured toinclude additional functionalities such as displaying data to the user.The headset 100 may be a stand alone unit or may be used in conjunctionwith other electronic devices. For example, the headset 100 may becoupled to an MU so that data may be exchanged between the headset 100and the MU. The coupling may be, for example, a wired connector from theheadset 100 with a jack that plugs into a port of the MU. The headset100 may include a head band 105, an audio output 110, a stabilizer 115,a boom 120, an audio input 125, an extender 130, a head-mounted display135, and an input/output (I/O) port 140.

The head band 105 may be a supporting mechanism to allow the headset 100to be used hands-free. The head band 105 may rest on a top surface of auser's head. The head band 105 may be partially elastic so that the headband 105 may flex to conform to the top surface of the user's head. Thehead band 105 may be manufactured, for example, of a semi-elasticpolymer with a spring metal interior. The stabilizer 115 may be apadding disposed at a first end of the head band 105. The padding mayprovide a comfortable end to the head band 105. Because the ends of thehead band 105 partially squeeze (e.g., to securely hold the head set 100on the user's head), the stabilizer 115 may allow the comfortable use ofthe headset 100. It should be noted that the headset 100 including thehead band 105 and the stabilizer 115 is only exemplary. The headset 100may include an ear clip so that the headset 100 may be worn on a user'sear. In such an embodiment, the head band 105 and the stabilizer 115 maybe unnecessary.

The audio output 110 may be, for example, a speaker. The audio output110 may be disposed at a second end of the head band 105. The audiooutput 110 may include a cushion substantially similar to the stabilizer115. Again, because the ends of the head band 105 partially squeeze, thecushion of the audio output 110 may provide the comfortable wearing ofthe headset 100. When the headset 100 is placed in a proper orientationon the user's head, the audio output 110 may be disposed around a user'sear. Furthermore, the stabilizer 115 may be disposed slightly above auser's other ear.

The boom 120 may be a flexible extension where a first end of the boom120 is attached to the second end of the head band 105 or the audiooutput 110. A second end of the boom 120 may be attached to the audioinput 125. The audio input 125 may be, for example, a microphone. Theflexibility of the boom 120 may allow a user to orient the headset 100so that the audio input 125 is disposed around a user's mouth. The audioinput 125 may include a foam coat so that sounds received by the audioinput 125 may be filtered. The first end of the boom 120 may be coupledto the second end of the head band 105 or the audio output 110 with arotator. In this embodiment, the audio output 125 may be rotated in anupward position when not being used. The audio output 125 may bedeactivated, thereby conserving power. Voice data received by the audioinput 125 may include voice commands relating to the components of theheadset 100. For example, the voice commands may activate/deactivate thehead-mounted display 135. In another example, the voice commands mayrelate to the MU.

The extender 130 may be another flexible extension where a first end ofthe extender 130 is attached to the head band 105. As illustrated, theextender 130 is disposed on a right side of the head band 105. However,it should be noted that the extender 130 may be disposed on a left sideof the head band 105 above the audio output 110, depending on apreference of the user. A second end of the extender 130 may be attachedto the head-mounted display 135. The flexibility of the extender 130 mayallow the user to orient the head-mounted display 135 over an eye of theuser. The head-mounted display 135 may be clear so that a user may viewdata thereon or view beyond the head-mounted display 135. Thehead-mounted display 135 may also occlude. The first end of the extender130 may be coupled to the head band 105 with a rotator. In thisembodiment, the head-mounted display 135 may be rotated in an upwardposition when not being used. The head-mounted display 135 may bedeactivated, thereby conserving power.

The I/O port 140 may be a device to connect the headset 100 to, forexample, an MU. The I/O port 140 may be configured to receive aconnector from the MU. It should be noted that the use of the I/O port140 is only exemplary. The headset 100 may not include an actual I/Oport 140. Instead, the headset 100 may be equipped with a connector anda jack to be received by a port of the MU. The I/O port 140 may alsoenable a wireless connection to be established with the MU. In theexemplary embodiment where a wireless connection is used, the headset100 may include its own processor, memory, transceiver, antenna, etc.

FIG. 2 shows a second view of the headset 100 of FIG. 1 according to anexemplary embodiment of the present invention. Specifically, the secondview illustrates an orientation of the audio output 110, the audio input125, and the head-mounted display 135 when worn by the user. Asdiscussed above, the audio output 110 may be disposed around the user'sear. The audio input 125 may be disposed around the user's mouth. Thehead-mounted display 135 may be disposed around the user's eye. Asillustrated, the audio output 110 and the head-mounted display 135 aredisposed to be worn on a right side of a user's face.

FIG. 3 shows components of an MU 200 used with the headset 100 of FIG. 1according to an exemplary embodiment of the present invention. The MU200 may be any portable electronic device that utilizes a portable powersupply (e.g., battery, capacitor, super capacitor, etc.). For example,the MU 200 may be a laptop, a personal digital assistant, a pager, acell phone, a scanner, an RFID device, etc. The MU 200 may include aprocessor 205, a memory 210, an input/output arrangement (I/O) 215, asensor 220, and a battery 225.

The processor 205 may be a central computing component that operates theMU 200. The memory 210 may store data related to the MU 200. The datamay pertain to programs installed on the MU 200, functionalitiesassociated with the MU 200, etc. In addition, as will be discussedbelow, the data may also include configuration data relating to inputsreceived by the sensor 220. Specifically, the configuration data mayindicate how a pointing device of the head-mounted display 135 moves inaccordance to the inputs.

The battery 225 may be a portable power supply that provides energy tothe MU 200. As discussed above, the MU 200 may be any electronic devicethat utilizes a portable power supply. The battery 225 may be arechargeable battery such as a nickel cadmium (Ni—Cd), a nickel hydride(Ni—H), a lithium ion, etc. It should be noted that the battery 225 maybe removed from the MU 200. While removed, the battery 225 may berecharged separately from the MU 200. The battery 225 may also provideenergy to any accessory connected to the MU 200 including the headset100.

The I/O 215 may be connected to at least one port disposed on aperiphery of the MU 200. The I/O 215 may be configured to establish anelectrical connection between an accessory and the MU 200. For example,as discussed above, the headset 100 may include a connector with a jack.The jack may be received in one of the ports of the MU 200. The I/O 215may recognize the reception and establish the electrical connectionbetween the MU 200 and the headset 100. As will be discussed below,other accessories may be connected to the MU 200. It should be notedthat the I/O 215 may establish the electrical connection in othermanners. For example, the I/O 215 may be a BlueTooth interface thatwirelessly communicates with the I/O of the headset 100. Thus, theheadset 100 may be wirelessly coupled to the MU 100.

The sensor 220 may be a motion or inertial sensor that is configured todetect a direction that the MU 200 is moved and/or determine an angle ororientation that the MU 200 is positioned. When the MU 200 is connectedto the headset 100, the direction in which the MU 200 is moved may betranslated by the sensor 220 or the processor 205 into a correspondingmovement of the pointing device on the head-mounted display 135. Forexample, if the MU 200 is moved left, the pointing device is also movedto the left. In another example, if the MU 200 is moved down and right,the pointing device is also moved down and right. The sensor 220 mayconsist of, for example, an accelerometer. A user may activate thesensor 220 when requiring a user interface for the pointing device.Activation may be achieved by various methods such as pressing a button,a voice command, a specific gesture recognized by the MU 200 throughprocessing the data provided by the sensor 220, etc. That is, a separateuser interface such as a mouse, a stylus, etc. is not required to movethe pointing device of the head-mounted display 135.

FIG. 4 shows an assembled system of components including the headset 100of FIG. 1, the MU 200 of FIG. 3 and a module 300 according to anexemplary embodiment of the present invention. As discussed above, theheadset 100 may be electrically connected to the MU 200. Furthermore,the headset 100 may be equipped with a connector (extending from theport 140) that has a jack disposed on a distal end. The jack may bereceived by a port that is connected to the I/O 215 of the MU 200. Also,as discussed above, a module 300 or accessory may be electricallyconnected to the MU 200. The module 300 may be connected to the MU 200in a substantially similar manner as the headset 100.

The module 300 may be any electronic device that provides an additionalfunctionality. For example, the module 300 may be a data capture devicesuch as a barcode scanner (e.g., one-dimensional, two-dimensional,color, etc.), a laser scanner, an imager, a camera, a radio frequencyidentification (RFID) reader, etc. In another example, the module 300may be a communications device such as a transceiver (if the MU 200 isnot equipped with such a functionality). The module 300 may be coupledto the MU 200 using any of the above described manners for coupling theMU 200 to the headset 100 such as a wired connection, a wirelessconnection, etc.

According to the exemplary embodiments of the present invention, the MU200 may be wearable. That is, the MU 200 may be coupled to a mount suchas a wrist mount, a finger mount, a waist mount, etc. The module 300 mayalso be wearable. For example, the module 300 may be a ring scanner thatis worn on a finger. The MU 200 and the module 300 may also be hand-helddevices that are held in a user's hand. It should be noted that themodule 300 may be absent in the assembled system. That is, the module300 may be an optional component that may be added to the system of theMU 200 and the headset 100. Thus, the MU 200 may only be coupled to theheadset 100.

The module 300 may also include a processor, a memory, a battery, anI/O, and a sensor. In another exemplary embodiment, the module 300 doesnot include a memory or a battery as data may be stored in the memory210 of the MU 200 and power may be provided by the battery 225 of the MU200. The I/O of the module 300 may be coupled to the MU 200. Theprocessor of the module 300 may be less complex than the processor 205of the MU 200 as the processor of the module 300 need only execute thefunctionality provided thereby. The module 300 may also include thesensor that is substantially similar to the sensor 220 of the MU 200.Thus, the module sensor may provide the movement data that is translatedinto the corresponding movement of the pointing device of thehead-mounted display 135. When the module 300 provides the movementdata, the MU 200 may not be equipped with the sensor 220 as it isredundant. Furthermore, when the module 300 provides the movement data,the MU 200 may be fixedly worn, for example, on a waist mount.

In another exemplary embodiment of the present invention, the MU 200 andthe module 300 may be equipped with the sensor (not shown). The sensorof the module 300 may be substantially similar to the sensor 220 of theMU 200. When the module 300 is present, the sensor of the module 300 mayoverride the sensor 220 of the MU 200. For example, when the module 300is connected to the MU 200, the sensor 220 may be deactivated while thesensor of the module 300 is activated. In another example, the type ofmount may determine activation or deactivation of the sensor. When awaist mount is connected to the MU 200, the MU 200 may recognize thatthe MU 200 is likely to remain fixed in position. Thus, the MU 200 maydeactivate the sensor 220.

It should be noted that the use of the module 300 is only exemplary. Themodule 300 may provide an additional functionality to the MU 200.However, the MU 200 may come equipped with the functionality provided bythe module 300. Thus, the module 300 may represent providing afunctionality that is not available to the MU 200.

FIG. 5 a shows a first movement of the MU 200 of FIG. 3 according to anexemplary embodiment of the present invention. As illustrated, the MU200 is hand-held, in particular, being held in a right hand of the user.The headset 100 (not shown) is worn on the user's head with thehead-mounted display 135 disposed over the user's right eye. The MU 200and the headset 100 may be coupled and the sensor 220 may be activated.The MU 200 may be moved in any planar direction. The first movementinvolves moving the MU 200 down in the direction d1. It should be notedthat the use of the MU 200 is only exemplary. As discussed above, themodule 300 may also include the sensor. Thus, the MU 200 may be worn,while the module 300 is hand-held or worn, for example, on the user'swrist or finger.

FIG. 5 b shows a first translation of the first movement of FIG. 5 a onthe head-mounted display 135 according to an exemplary embodiment of thepresent invention. FIG. 5 b shows a view of how the user sees thehead-mounted display 135. As discussed above, the head-mounted display135 may include a pointing device 135 a. It should be noted that theillustration of the first translation assumes that the point device 135a was originally located in a central position on the head-mounteddisplay 135. The first movement of FIG. 5 a is in the direction d1. Thedirection d1 is measured by the sensor 220 as going straight downward.Thus, this movement may be translated into a straight downward movementof the pointing device 135 a.

FIG. 6 a shows a second movement of the MU 200 of FIG. 3 according to anexemplary embodiment of the present invention. As illustrated, the MU200 is hand-held, in particular, being held in a right hand of the user,while the headset 100 (not shown) is worn on the user's head with thehead-mounted display 135 disposed over the user's right eye. The MU 200and the headset 100 may be electrically connected and the sensor 220 maybe activated. The second movement involves moving the MU 200 upward andto the right in the direction d2. It should again be noted that the useof the MU 200 is only exemplary and the movement may be of the module300.

FIG. 6 b shows a second translation of the second movement of FIG. 6 aon the head-mounted display 135 according to an exemplary embodiment ofthe present invention. FIG. 6 b shows a view of how the user sees thehead-mounted display 135. As discussed above, the head-mounted display135 may include the pointing device 135 a. It should again be noted thatthe illustration of the second translation assumes that the point device135 a was originally located in a central position on the head-mounteddisplay 135. The second movement of FIG. 6 a is in the direction d2. Thedirection d2 is measured by the sensor 220 as going upward and to theright. Thus, this movement may be translated into an upward and to theright movement of the pointing device 135 a.

FIG. 7 a shows a third movement subsequent to the second movement ofFIG. 6 a of the MU 200 of FIG. 3 according to an exemplary embodiment ofthe present invention. In this exemplary embodiment, the third movementrelates to moving the MU 200 upon moving the MU 200 in the direction d2.The third movement involves moving the MU 200 down in the direction d3.

FIG. 7 b shows a third translation of the third movement of FIG. 7 a onthe head-mounted display 135 according to an exemplary embodiment of thepresent invention. FIG. 7 b shows a view of how the user sees thehead-mounted display 135. In this exemplary embodiment, the pointingdevice 135 a′ was originally located in an upper right corner of thehead-mounted display 135. The third movement of FIG. 6 a is in thedirection d3. The direction d3 is measured by the sensor 220 as goingstraight downward. Thus, this movement may be translated into a downwardmovement of the pointing device 135 a from the position last seen inFIG. 6 b.

The exemplary embodiments of the present invention enable a user toutilize a pointing device for a head-mounted display without requiring ause of both hands of the user. For example, if the MU is hand-held, atouch pad or stylus may be necessary to move the pointing device. Thus,one hand may hold the MU while the other hand uses the interface to movethe pointing device. The sensor disposed in the MU and/or the module ofthe exemplary embodiments allow the pointing device to be moved with asingle hand. As discussed above, a movement of the MU or the moduleitself translates into the movement of the pointing device.

The exemplary embodiments of the present invention also enable a user toutilize a pointing device for a head-mounted display without requiringthe user to move the user's head. For example, if the MU is hand-held, atouch pad or stylus may be necessary to move the pointing device. Ineach of these cases, the user is required to look down at the MU inorder to use the pointing device. With the sensor integrated in the MU200 or module 300, the user does not need to look away from thehead-mounted display.

It will be apparent to those skilled in the art that variousmodifications may be made in the present invention, without departingfrom the spirit or scope of the invention. Thus, it is intended that thepresent invention cover the modifications and variations of thisinvention provided they come within the scope of the appended claims andtheir equivalents.

What is claimed is:
 1. A headset, comprising: a computing arrangementsituated at least partially on a head of a user, the computingarrangement including a first processor; and a display coupled to thefirst processor of the computing arrangement, the display capable ofdisplaying a pointing device to the user, wherein the computingarrangement is coupled to a mobile device including a second processorand a motion sensor, the motion sensor detecting a direction of movementof the mobile device and the second processor generating direction datain response to the detected movement that is displayed as a movement ofthe pointing device on the display and further wherein the mobile deviceis coupled to an accessory including an accessory sensor wherein anactivation of the accessory sensor deactivates the motion sensor of themobile device.
 2. The headset of claim 1, wherein the headset is coupledto the mobile device through one of a wired connection and a wirelessconnection.
 3. The headset of claim 1, wherein the mobile device iscoupled through one of a wired connection and a wireless connection tothe accessory and further wherein the accessory sensor detects a seconddirection in which the accessory is moved to generate secondcorresponding direction data, and the display displays to the user asecond corresponding movement of the pointing device which is determinedas a function of the second corresponding direction data.
 4. The headsetof claim 3, wherein the accessory is a data capture device including atleast one of a scanner, an imager, a camera, and a radio frequencyidentification reader.
 5. The headset of claim 1, wherein the display isoriented to be over an eye of the user.
 6. The headset of claim 1,wherein the motion sensor comprises an inertial sensor.
 7. The headsetof claim 1, wherein the motion sensor comprises an accelerometer.
 8. Theheadset of claim 1, wherein the display is coupled to an extenderextending from a frame of the headset.
 9. The headset of claim 8,wherein when the extender is moved in an upright position, the displayis deactivated.
 10. The headset of claim 1, further comprising: an audioinput receiving voice data, the voice data including voice commands oneof activating and deactivating the display.
 11. A mobile device,comprising: a computing arrangement having a second processor coupled toa headset that includes a display and a first processor, the displaycapable of displaying a pointing device to a user; and a motion sensorcoupled to the second processor, the motion sensor detecting a directionof movement of the mobile device and the second processor generatingdirection data in response to the detected movement that is displayed asa movement of the pointing device on the display wherein the mobiledevice is coupled to an accessory including an accessory sensor andfurther wherein the activation of the accessory sensor deactivates themotion sensor of the mobile device.
 12. The mobile device of claim 11,wherein the mobile device is coupled to the headset through one of awired connection and a wireless connection.
 13. The mobile device ofclaim 11, wherein the mobile device is coupled through one of a wiredconnection and a wireless connection to the accessory wherein theaccessory sensor detects a second direction in which the accessory ismoved to generate second corresponding direction data and the displaydisplays to the user a second corresponding movement of the pointingdevice which is determined as a function of the second correspondingdirection data.
 14. The mobile device of claim 13, wherein the accessoryis a data capture device including at least one of a scanner, an imager,a camera, and a radio frequency identification reader.
 15. The mobiledevice of claim 13, wherein the mobile device is fixedly mounted. 16.The mobile device of claim 11, further comprising: a portable powersupply providing energy to at least one of the mobile device and theheadset.
 17. The mobile device of claim 11, wherein the motion sensorcomprises an inertial sensor.
 18. The mobile device of claim 11, whereinthe motion sensor comprises an accelerometer.
 19. The mobile device ofclaim 11, wherein the motion sensor is manually activated.
 20. A system,comprising: a headset including a computing arrangement situated atleast partially on a head of a user and a display capable of displayinga pointing device to the user, the computing arrangement including afirst processor; a mobile device coupled to the headset, the mobiledevice comprising a second processor and a motion sensor coupled to thesecond processor, the motion sensor detecting a direction of movement ofthe mobile device and the second processor generating direction data inresponse to the detected movement that is displayed as a movement of thepointing device on the display; and an accessory coupled to the mobiledevice, wherein the accessory includes an accessory sensor and furtherwherein an activation of the accessory sensor deactivates the motionsensor of the mobile device.